RESPONSE TO A SETPOINT CHANGE IN PID CONTROLLED 
TIME-DELAY FEEDBACK SYSTEMS 



GIANPASQUALE MARTELLI 

Abstract. The response to a setpoint change in PID controlled feedback 
systems plays an important role for the tuning methods. This response may 
be easily evaluated in linear systems without delay by solving the related 
ordinary differential equations. These equations are also obtained for system 
with delay, if the delay exponential term is approximated to a polynomial by 
one of the Pade expressions. If this simplification is avoided, one must deal 
with differential difference equations. In this paper their explicit solution, 
obtained with the method of steps, is presented. Moreover a second order 
equation is investigated as example and the complete set of the coefficients 
formulas is given. 



1. Introduction 

The closed-loop response of a feedback control system can be considered one of 
the main behaviour taken into consideration for a proper tuning. A very common 
and normally desired goal consists of a deadbeat response (see para. 10.2.5 of p] 
p. 171) i. e. the wanted value of the controlled variable, after a setpoint change, is 
achieved as fast as possible and held within a narrow band. This operation mode 
has been completely studied and successfully applied only to the systems without 
delay. The Ziegler-Nichols tuning method [2], which is the most known and used 
one, considers the quarter amplitude decay ratio, obtains the process parameters 
values from an open-loop test and consequently gives simple relationships between 
them and the controller ones. An another is the Kappa- Tau method [3], based 
on a step response experiment, which supplies parameters relationships obtained 
applying dominant pole design, at constant maximum sensivity gain, on typical 
process control models. Moreover there are optimization criteria, minimizing the 
integrated error during a step response, but calculated after the reduction of the 
exponential time-delay term to a polynomial form by means of a Pade approxima- 
tion (see for example [1]). Finally the actual commercial controllers, which can be 
single in separate hardware box or multiple in distributed control systems (DCS), 
are provided with adaptive techniques (see para. 52.4 of [T| p. 825). Most of these 
techniques are based on step response analysis and the controller parameters are 
adjusted according to some rules in order to have a performance index inside a 
preset range. 

From these preliminary remarks it follows that a strict and simple formula, not 
yet available, of a setpoint change response can be helpful for an accurate and safe 
controller tuning of time-delay systems and hence it will be the aim of this paper. 
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The transfer functions of the PID controller T c (s) and process T p (s) , taken into 
consideration, are given by 

(1.1) T c (s) = k + ki/s + k d s 

iph=m h -2 h 

(1.2) TJs) = e- s . h 

where m& <= m a . The differential difference equation related to the closed- loop 
tranfer function is described by 



ri ,x *v(t) ^ h d h y(t 1) ^ <m-V) 

h=l h=0 h=0 

subject to an initial condition of the form y(t) — yo,k(~k) for each of the q consecutive 
intervals —1 + t^-i < t < —1 + (rk—i < Tk, tq = and r q = 1 ) and where 

- y(f) is the controlled variable 

- f(t) is the setpoint 

- t is the normalized time referred to the time delay 

- ah, bh and Ch = bh are constants 

- m a , mi, and m c — mj, are positive integers 

The solution of Q1.3P can be evaluated by means of the method of the Laplace 
transform, as a contour integral or as an infinite exponential series, or by means 
of the method of steps [5] , [6] . The contour integral cannot be expressed in terms 
of elementary functions and for the exponential series, helpful for the study of 
the behaviour for higher values of the independent variable, an approximation is 
needed; therefore both are not suitable for an accurate evaluation of the solution 
for low values of the time. On the contrary this is not true for the method of steps, 
since, denoting y n ^ as the solution valid for n — 1 + Tk-\ < t < n — 1 + r^, 2/i,fe 
can be analytically evaluated solving (|1.3|) . which can be considered as an ordinary 
differential equation. Any consecutive y n _k can be analogously determined, but 
tedious calculations will be necessary at each time if a general expression will not 
be found. 

This general solution exists provided that the initial condition yo,fc(i) and the 
forcing term f n ,k(t) are each a finite sum of the terms of the complementary solution 
of (II. 31) . but with a null time delay, each multiplied by a polynomial of t. The 
solution y n ,k(t) will be of the same form. In detail: 

p=m a i=v kp +n 

(1-4) VnAt) = E ^ E G n^ P J l 

p=l i=0 



p=m a i—Wig , p +n 

(i.5) /»,*(*) = E eM E Kk,v/ 

p=l i=0 

where Vk lP and Wk, P are positive integers with Vk,p >= Wk, p , 1 <= k <— q and 
r p are the characteristic roots of the corresponding ordinary differential equation 
without time delay. These roots are assumed all simple and real in this paper, 
but the adopted procedure can be used also if multiple real or complex roots are 
present. 



3 



It is worthwhile to note that, thanks to the integrating term of the PID controller, 
one of the characteristic roots r p is null and therefore steady initial conditions and 
setpoint step changes, which are usually encountered in the tuning methods, yield 
solutions compatible with (|1.4p . 

Since the coefficients G* k i are considered, in the method of steps, unknown 
for u = n and known for u = n — 1, the necessary and sufficient conditions for the 
correctness of (|I.4j) . for a given u, are: 

(1) equal number of each different term depending on the time e rpt t l included 
in both sides of (jf.ip . modified by the introduction of (|1.4p 

(2) the total number of the coefficients G^ k p i equal to the sum of the number 
of all above mentioned terms e rpt t l and the continuity equations one. 

These two conditions are fulfilled and will be checked in the next Section. 

2. Main results 

The sought expressions of the coefficients are simpler if, for each y n ^ and f n ,k, 
the origin of the temporal axis t n is assumed coincident with n — 1 (t = n — 1 + 
Therefore (|I.4[) and (|I.5[) can be rewritten, for n >= 0, as 



p=m a i—Vk.p+n 

(2-1) y n , k (tn) = ^ £ G »,fc,f,4 



p=l i=0 



p=m a i=w k p +n 



(2.2) fn,k(tn) / , C P / . ^n,k,p,itn 

p=l i=0 

Since £„_i — 1 = t n holds and since the trasformations from p.4p to (|2.ip and 
from (jf.5p to (|2.2[) substitute t with in y n ^ and with i„_i in y n ~i,k and f n —i,k, 
()I.3p becomes 

n ) \ A ^ fn—l,k (^n) 

( 3) S a,i ^r~ = " £ — < — S c,i — < — 

h=l " h=0 ™ h=0 ™ 

subject to the following continuity equations: 

^ 24 ^ 2/n,i(0) =y„_i, g (l) fork = l 

y n ,k( T k-l) =Vn,k-l{Tk-l) fork>l 

d h y n ,i(0) _ ^n-i, g (!) , ,_ 1 
~ ^ joric-i 

(2.5) ™ " 

= <*W-ifo-i) /orfc > wo < fc < 

Let introduce in (|2.3p the solution (|2.ip and its derivatives, evaluated according 
to (jA.ip . The necessary and sufficient conditions of the correctness of (|2.II) can be 
detailed for each n > and each fc as follows: 
(I) number of the terms e Tpt t l 

(a) left-hand side of (|2.3p : 2p=T !l ( Ufe >P + n ) 

it is < i < Vk,p + n, but the coefficient of t"n' v+n is null since it is 
equal to the characteristic polynomial of the corresponding equation 
without time delay 
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(b) right-hand side of (|2.3|) : J2pZT a ( v k,p + n ) 
it is < i < Vk, P + n — 1 

(2) coefficients G n ,k,p,i ( 1 < i < «fc,p + 

(a) number of the equations (|2.3p (see item (1)): J2pZT" ( Vk >p + n ) 

(b) number of the unknowns : X)p=" la ( v k,p + n ) 

G n ,k,p,o has as coefficient the characteristic polynomial of the corre- 
sponding equation without time delay and then disappears 

(3) coefficients G^fc^o ( 1 < P < TO a) 

(a) number of the equations (|2.4[) and (|2.5p : m Q 

(b) number of the unknowns: m a 

The analytical trasformations required for the evaluation of the coefficients for- 
mulas are quite simple. Since series products exist in both sides of (|2.3p and the 
series of the power of t is in the last right position, it is only necessary to shift 
this series from its actual position to the first left one, modifying accordingly the 
initial and the final values of all indexes. In this manner the coefficients of e Tpt t % 
of both sides, each consisting of the entire expression following this first series, can 
be correctly equated and therefore (|2.3|) become an identity for any value of t. 

In detail: 

(1) i > 

Introducing (|2.1j) and its derivatives, evaluated according to (jA.lj) . in the 
left-hand side LHS and in the right-hand side RHS of (|2.3| . we obtain 

p—m a 

(2.6) LHS= (.Si(m a ) + S 2 (m a , v k ,p + n))P nyk ,h,p,t,je rptn t J n 

P =i 

p=m a j=v k p +n-l 

RHS = + E E {Qn,k,0,p,j : j + Rn,k,a,p,j,j)e lptn t : ' n 

p—m a 

(2.7) + {Si(m b) + S 2 (m b ,v k , p + n - l))Qn,k,h,p,i,je rptn t 3 n 

P =i 

p—rn a 

+ E (Si(m c ) + S 2 (m c ,w k ,p + n- l))R n ,k,h, P ,i,je rptn t : > n 
P =i 



where 



h—mi—h — l j—i 

Si(m) = e E E 

h—m i—z j—i 

S 2 {m,z) = J2 E E 

h—1 i—h j—i—h 
p , . , . — „, r h-*+3 n t 

p jl(*-.7)l(k-* + j) 



r~\ j h — i+ j l\h\ „ 

^cn.k.h.p.i.j ^h^r> ■ 1 7 ■ -\ ■ 7 7 '• ! a" ^n — l.k.p.i 



1 ^n.k.h.p.i,'] ' wi 'rj .(/. -\i/7 ■ , -\ 1 n— l.k.p.i 

p r\i - jy\h -1 + 3) 
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It is now necessary to shift the index j series, in Si(m) and ^(m, z), from 
the last right position to the first left one according to the series identities 
detailed in Appendix B. Before making equal the coefficients of t° included 
in LHS (j2Hj) and in RHS (|2Jf it is worthwhile to note that, for i = j, 
Pn,k,h,p,i,j is given by 

L*n ,k ,h .p ,i ,i — ^h^*p ^n,/c,p,i 

and that the following holds 

h—m a h—m a 

(2.8) 2^ Pn,k,h,p,i,i = Gn,k,p,i ^ 0>hTp = 

h=l h=l 

because the coefficient of G n ,k,p,i, which is the characteristic polynomial of 
the corresponding ordinary differential equation without time delay, is null. 
The coefficients of the terms P of LHS (12. 6j) are consequently deleted as 
follows: 

(a) term with j — 0: G n ^,p,o, existing only in this case 

(b) each term from j = 1 to j = n + Vk. p — 1: G n ^k,p,j 

(c) term with j = n + Vk, p : G n . k , p , n +v k}P , only one present 

Finally the coefficient matrix of the system, consisting of t>fc jP + n linear 
equations obtained making equal the coefficients of the terms P belonging 
to LHS and RHS, is triangular and provided with m a diagonals starting 
from the central one. The unknowns G n ^,p,i, from i — n + Vk, p to i = 1, 
can be evaluated in function of G n -\^,p,i, for each value of n, k and p, 
recursively or with the analytical solution of the system, obtained by means 
of a consecutive elimination of the unknowns. 
(2) i = 

Defining ff e , n ,fc,h(in) as 

p=m a i=n+v kp 

ffe, n ,fc,o(*n) = £ ^ £ Gn.k^t^ forh = 
p—1 i—e 



' p—m a i—n-\-Vk, P 

He,n,k,h (tn ) — ctfch ( ^ ^ £ p n ^ ^ Gn,k,p,it r , 
p—1 i—e 



p—7n a i i—h — 1 j—i i—n-\-Vk_ p j—% 

= £ ££+£ £ I ' 

p—1 \ i—e j—0 i—h j—i — h 

i\h\ 



j\(i-j)\(h-i + j) 
2T4]) and (|2?5l) become, for <= h <= m a - 1 



G n ,k,p, t e rptn ti forh>0 



(2-9) 



p—m a 

£ 

P =i 



X! r p'G n ,i,p,o = -ifL„,u(0) + ff , rl -i,,i(l) /orfc = l 
p=i 

e rpT '" 1 ^G n ,it,p,o = - i?i ,„ ,k,h(rk-i) + H 0:U , fe _i ,fc(T fe _i) fork>\ 



For each value of fc the coefficient matrix of the system, consisting of the 
m a linear equations ()2.9|) . is a Vandermonde matrix, whose terms of each 
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column, for k > 1, are multiplied by a constant. This system can be 
analytically solved with respect to the m a unknowns G n ,k,p,o by means of 
the Cramer's method and of the Laplace's expansion, thanks to the known 
expression of the Vandermonde determinant, as detailed in Appendix C. 



3. Examples 

Let consider a first-order plant and hence assume m a — 2, mt — 2, ao = 0, 
ai = 1, a.2 = t p . Two cases, whose the first related to a preset initial condition 
with q > 1 and to a setpoint always null and the second related to a steady initial 
condition with q = 1 and to a setpoint change from 1 to 0, are examined. 

3.1. Example no.l. Since q > 1, = (n >= 0), (|2.3p and (|2.ip become 
dy n ,k(t n ) . , d 2 y n . k (t n ) 

T+ + P Tu2 = —Ooy n -l,k{ t n) 

_ b dy n ^ k {t n ) _ rf 2 y ra -i,fcft«) 
dt n dt n 

(3.2) Vn,k(tn) = ^ G„,fe,l,,^ + e~ tn / tp ^2 Gn,k,1,it l n 

■i=0 i=0 

The expressions of G n ^k,p,i for n > are given by 
a) i > 

Gnfeii = -— G n -x ,fc,i,i-i /ori = «k,i +n 
z 

G n k,iA + t p (i + l)G n k ,i = G„_i 1 1 j_i — 6iG n _i fc i j 

z 

/or z = + n - 1 

G n k,i,i + t p (i + l)G n ,k i i+i = — r G„_i i i_i — 6iG n _i 1 1 a 

i 

- b 2 (i + l)G„-i,fc,M+i f ori <= v k,i +n-2 
b 3 

G nik ,2,i = +— G>j_i fc 2 ,i-i for i = v k 2 + n 
i 

b 3 

G n ,k,2,i — tp{i + 1)G„ k ,2,i+l = H G„_i k ,2,i-l + biG n -i k ,2,i 

I 



for i = v k ,2 +n—l 
bz 

- +— G n -\.k,2,i-\ + bi 

I 

+ b 5 (i + l)G n -i,k, 2, 4 +i for i<=Vk,2+n-2 



b 3 

G n ,k,2,i — tp{i + 1)G„ k ,2.i+l = +— G n -l.k,2,i-l + biG n -i^.2. 

I 



where 



bi , b 2 
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b) i = Ok= 1 

r 4-11 (l\,f ^n-lJX) 

<^n,k,l,i — + yn-l,q(i-) + tp "T7 

— tpG n ,k,l,i+l — t p G ni k,2,i+l 

r + ' 

^-*n,k,2,i i p ~ 



dj/„-i,g(l) 



+ t p Gn t k,l,i+l + t p G n ,k,2,i+l 

where G n ,/c,i.i+i and G n ,k,2,i+i exist respectively only for n + Ufej >= 1 
and n + Vk,2 >= 1- 
c) i = k > 1 

n . f s , . ^n,fc-l( r fc-l) 
lJn,fc,l,i = + J/n./c-l^Tfe-lJ + Ep 



/t=-Wfc,i+n 

— ^ (Tfe-i +t p h)T%ZiGn,k,l,h 
h=l 

tph T k-lG n ,k,2,h 

h=l 



e - T k-l/tp 



'i=«fc,i+" 

^ ' tp h,T^_^G ni k,l,h 



h=l 

h=v k 2 +n 



^ (—Tk-l+t p h)T^_^G n! k,2,h 



h=l 

3.2. Example no. 2. Since q = 1, yo.i = 1, /n,i = 1 for n = and / n ,i = for 
n > 0, (|2~3jl and (|23]) become 

dyi,i{t„) d 2 y 1 , 1 (t n ) _ 

dtn +P dtl 

f o<>\ dy nA (t n ) d 2 y n s{t n ) 

( 3 - 3 ) — j t \-t P ^ = -b y n -i,i(t n ) 

" 5l A &2 dT 2 forn>l 

Lily T-i UjU^-, 



(3.4) 



= Gi, 1,1,0 

i—n—l i—n—2 
VnAtn) = G n,lA,i t i + e ~ tn/tp Y G n,l,2,»4 fom>\ 



i=0 i=0 

Comparing (|3 . 1 1) and (|3.2[) with (|3 . 3[) and (|3.4p . it follows that Gi,i.i,o = 1 and 
the expressions of the coefficients G n .i, P ,i, detailed in Example no.l for i > and 
i = Ok = 1, are valid also for n > 1 in Example no. 2 assuming q = 1, t>i,i = — 1 
and i?i 2 = —2. 



8 



GIANPASQUALE MARTELLI 



4. Conclusion 

The found explicit solution of neutral differential difference equations will allow 
to refine the existing tuning procedures and to implement new ones for the PID or 
other controllers, used in linear systems of unlimited order provided with one time 
delay. 

Appendix A. Derivatives of y = e rt t l 
The hth derivative of y — e rt t l is given by 



O = e rt T — r h - i+ H* forh < i 

(A.l) 

rtST^ ^ h-i+i+i ? ; 

-f = e rt > — — r n l+ H J forh>i 

These formulas can be checked by comparing the derivative of (jA.lj) to the expres- 
sion assumed by (jA.ip when h is replaced with h + 1. 

Appendix B. Identities of series products 
Let define the series products Si(m) and S 2 ('m, z) as 

h—m i—h — 1 j—i 

(B.i) SiM=£ E E 

h=l i=0 j=0 
h—m i—z j—i 

(B.2) S 2 (m,z)= EE E 

h—1 i—h j—i—h 

Shifting in (|B~T]) and ([B~2|) the j series from the third to the second position, we 
obtain 

h=m j=h — l i=h — l 

(B.3) Sx(m)=E E E 

h=l j=0 i=j 

(B.4) S 2 (m, z) = S 2 i + S 22 + S23 + S 2 4 + S25 + S 2 6 

where 

h—int[z/2] j—h — 1 i—h+j 

= E E E 

h=l j=0 i=h 
h=int[z/2] j=z — h i=h+j 

E E E 

h=l j=h i=j 
h=int[z/2] j=z i=z 

= E E E 

h— 1 j—z — h-^-l i—j 
h—m j=z—h—l i—h-^j 

= E E E 

h=int [z/2] + 1 J=0 i=h 
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h=m j=h i=z 

E EE 

h=int[z/2]+l j=z—h i=h 
h—m j—z i—z 

s» = E EE 

h=int[z/2]+l j=/i+l i=j 

Shifting in (|B.3|) and in (|B.4|) the j series from the second to the first position, we 
obtain 

j=m— 1 h=m i=h— 1 

*("»)= E E E 

j=0 fc=j+l i=j 
j=int [z/2]-l fi.=mi[2/2] i=h+j 

= E E E 

j=irat[z/2] /i=j i=h+j j=z—l h=z—j i=h+j 

E E E + E EE 

j = l h=l i=j j"=int[z/2] + l h=l i=j 
j'=z fi.=mf[2/2] i = z 

&»= E EE 

j=z+l-int[z/2] h=ar-j+l *=j 
j=z— 1— m fi=m i=h+j j=z — 2—int[z/2] h=z — l—j i=h+j 

**= E E E+ E EE 

j'=0 h=int[z/2] + l i=h j=z — m h=int[z/2] + l i=h 

j—z—int[z/2]—l h=m i=z j=int[z/2] h=m i=z 

E E E+ E EE 

j—z — m h—z—j i—h j—z~int[z/2] h—int[z/2] J r l i—h 
j—m h—m i—z 

+ E EE 

j'=int[z/2]+l h=j i=/i 

j=m+l h=j—l i=z j=z h=m i=z 

E E E+ E E E 

j=int{z/2}+2 h=int[z/2] + l i=j j=m+2 h=int[z/2] + l i=j 

Each series identity can be easily verified by means of the Terms Grid, detailed 
as example in Table 1. for (|B.1[) and (|B.3p . The symbol x in the grid cell, whose 
row and column numbers are respectively i and j, means the existence of the term, 
whose indexes are i and j. 

Table 1. Terms Grid of (|B~T|) and |B~3)) 





j 







1 


2 




h-1 







X 












1 


X 


X 








i 


2 


X 


X 


X 










X 


X 


X 


X 






h-1 


X 


X 


X 


X 


X 
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Appendix C. Vandermonde equations system 
A Vandermonde equations system of mth order is described by 

(C.l) d i r j~ lx i = z i l<i<m 

3=1 

where dj, rj and Zi are constant. The solution, evaluated with the Cramer's metod, 
is given by 

(C.2) Xj = U U " Z * 

where V is the determinant of the coefficient matrix My and Uij is the determinant 
of the submatrix Mjj, obtained deleting the ith row and the jth column from this 
matrix. The determinant V is obviously a Vandermonde one and also Uij can be 
expressed as a sum of products of two Vandermonde submatrix determinants, if it 
is calculated according to the Laplace's expansion, i. e. assuming 

- for the first submatrix Mi 

as rows the i — 1 rows from 1 to i — 1 of My and as columns the i — 1 
columns, belonging to one of the N — (m — l)!/((« — l)!(m — sets and 
selected among the m — 1 ones of M v . 

- for the second submatrix M 2 

as rows the m — i rows from i + ltomof My and as columns the remaining 
ones of Mjj i.e. not included in M\. 

In detail: 



(C.3) V=l[(r a -r b )l[d 

a>b j=l 



^'3 



=N 



(C4) Uij= ^{-ly-Wij,* 

where 



n=l 



h— i— 1 k—i—1 
h=l fc=l 

fc=»-l 

Wi,j in = ] | (^pa(n,fe) - r pb{n,k)) _[T ^pa(n,fc) 

pa(n,k)>pb{n,k) k—1 

k—m — i 

(>"ga(n,fc) ~ r qb(n,k)) \\ dqa(n,k) r \ a (n,k) 
qa(n,k)>qb(n,k) k—1 

• h is the row number of My 

• fc is the current column number of Mi or M2 

• pa(n, fc) or pb(n, fc) is the number of the column, included as kth in Mi in 
increasing order, of Mjj 

• qa(n, fc) or qb(n, fc) is the number of the column, included as kth in Mi in 
increasing order, of Mjj 
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